clean dish
Experiences from Benchmarking Vision-Language-Action Models for Robotic Manipulation
Zhang, Yihao, Qi, Yuankai, Zheng, Xi
Foundation models applied in robotics, particularly \textbf{Vision--Language--Action (VLA)} models, hold great promise for achieving general-purpose manipulation. Yet, systematic real-world evaluations and cross-model comparisons remain scarce. This paper reports our \textbf{empirical experiences} from benchmarking four representative VLAs -- \textbf{ACT}, \textbf{OpenVLA--OFT}, \textbf{RDT-1B}, and \boldmath{$π_0$} -- across four manipulation tasks conducted in both simulation and on the \textbf{ALOHA Mobile} platform. We establish a \textbf{standardized evaluation framework} that measures performance along three key dimensions: (1) \textit{accuracy and efficiency} (success rate and time-to-success), (2) \textit{adaptability} across in-distribution, spatial out-of-distribution, and instance-plus-spatial out-of-distribution settings, and (3) \textit{language instruction-following accuracy}. Through this process, we observe that \boldmath{$π_0$} demonstrates superior adaptability in out-of-distribution scenarios, while \textbf{ACT} provides the highest stability in-distribution. Further analysis highlights differences in computational demands, data-scaling behavior, and recurring failure modes such as near-miss grasps, premature releases, and long-horizon state drift. These findings reveal practical trade-offs among VLA model architectures in balancing precision, generalization, and deployment cost, offering actionable insights for selecting and deploying VLAs in real-world robotic manipulation tasks.
- Oceania > Australia > New South Wales > Sydney (0.04)
- Asia > South Korea > Daegu > Daegu (0.04)
- North America > United States > Massachusetts > Middlesex County > Cambridge (0.04)
- Information Technology > Artificial Intelligence > Robots (1.00)
- Information Technology > Artificial Intelligence > Natural Language > Large Language Model (0.46)
- Information Technology > Artificial Intelligence > Machine Learning > Reinforcement Learning (0.46)
- Information Technology > Artificial Intelligence > Representation & Reasoning > Object-Oriented Architecture (0.34)
Eco-friendly dishwasher uses superheated steam instead of soap to clean dishes
New dishwasher technology could soon save you money on water, electricity and detergent, a study reveals. Researchers have performed simulations of a dishwasher system that uses superheated steam instead of soap to clean dishes. Superheated steam is an extremely high-temperature vapour generated by heating the saturated steam obtained from boiling water. Results of computer simulations suggest that such a dishwasher would be able to kill 99 per cent of bacteria on one plate in just 25 seconds. As yet, the dishwasher only exists as a computer model, and not a physical object, but researchers say their study provides a basis for the development of next-generation dishwashers'.
- North America > United States > California > San Mateo County > San Carlos (0.05)
- Europe > Germany > Bavaria > Upper Bavaria > Munich (0.05)